PCT 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




(51) International Patent Classification 6 : 




(11) International Publication Number: 


WO 99/40729 


H04N 9/11, 1/48 


Al 










(43) Internationa! Publication Date: 


12 August 1999 (12.08.99) 



(21) International Application Number: PCT/US99/01674 

(22) International Filing Date: 26 January 1999 (26.01.99) 



(30) Priority Data: 
60/073,602 



4 February 1998 (04.02.98) 



US 



(71) Applicant: APPLIED SCIENCE FICTION, INC [US/US]; 

8920 Business Park Drive, Austin, TX 78759 (US). 

(72) inventors: EDGAR. Albert, D.; 3912 Eton Lane, Austin, IX 

78727-6069 (US). PENN, Steven, Q; 6005 Tonkawa Trail, 
Georgetown, TX 78628 (US). 

(74) Agent: CAYWOOD, Michael; Locke. Liddell & Sapp, LLP, 
Suite 300. 100 Congress Avenue, Austin. TX 78701 (US). 



(81) Designated States: AL, AM, AT, AU, AZ, BA. BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, BS, FI. GB, GD, 
GE ( GH, GM, HR, HU. ID, IL, IN, IS, JP, KE. KG, KP, 
KR, KZ, LC, LK. LR, LS t LT, LU, LV, MD, MG, MK, 
MN, MW, MX, NO, NZ, PL, PT, RO, RU. SD, SE. SG. 
SI, SK, SL, TJ, TM, TO, TT, UA, UG, UZ, VN, YU, ZW, 
ARIPO patent (GH, GM f KE, LS, MW, SD, SZ, UG. ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), 
European patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, 
GB, GR, IB, IT, LU, MC, NL, PT, SE), OAPI patent (BF, 
BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NB, SN, 
TD. TG). 



Published 

With international search report. 



S3 



rn 



- (54) Title: MULTILINEAR ARRAY SENSOR WITH AN INFRARED LINE 

(57) Abstract 

Surface defect correction technology for photo- 
graphic images requires an infrared scan along with 
a conventional color scan. In the present invention, 
the_ additional infrared scan needed for surface de- 
fect correction is obtained by adding a line of sensors 
specific to infrared light to a conventional multilinear 
color sensor array. The invention teaches a practical 
mode of distinguishing infrared light using a dichroic 
prism placed over the sensor. This mode has the 
additional advantage of placing the infrared-specific 
sensor line in a displaced focus plane to match con- 
ventional lenses. Adding a sensor line to a conven- 
tional bilinear sensor array requires a quadrilinear ar- 
ray topology. In addition to the direct quadrilinear 
topology, the invention teaches a method of obtain- 
ing full color image information with only two linear 
sensor lines by interstiually mixing red and blue sen- 
sors on a single sensor line, which, in conjunction 
with the additional infrared line, results in a conven- 
tional bilinear sensor topology with a different filter 
arrangement 
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MULTILINEAR ARRAY SENSOR WITH AN INFRARED LINE 
TECHNICAL FIELD OF THE INVENTION 

5 

This invention relates to the scanning of photographic images, and more particularly 
in a primary application, to scanning in infrared and visible light in order to prepare for 
correction of surface defects. 

10 BACKGROUND OF THE INVENTION 

FIG. 1 shows a prior art trilinear film scanner, and also introduces some terras that 
will be used in this application. A lamp 102 transilluminates a filmstrip 104 containing an 
image 106 to be scanned. Normally the light from the lamp 102 would be diffused or directed 

15 by additional optics, not shown, positioned between the lamp 102 and film 104 in order to 
illuminate the image 106 more uniformly. The image 106 on the film 104 is focused by lens 
108 onto a sensor line 1 10 in a circuit package 1 12. The sensor line 110 projects back through 
lens 108 as a line 1 16 across the image 106. This line 1 16 is composed of many individual 
points, or pixels. To scan the entire image 106, the film 104 is moved perpendicularly to the 

20 line 1 16 to scan a two dimensional area, such as image 106. Because the sensors of the sensor 
line 1 10 are positioned in lines, this arrangement is called aiinearrGFline, sensor. 

The sensor line 110 may be of a form known in the art as a <4 trilinear"\ or three line, 
array. As shown magnified at 120, the sensor line 1 1 0 actually consists of three parallel lines 
of sensors. In this prior art embodiment, one line of sensors 122 is behind a line of red filters 

25 124. This arrangement could consist of arseries^TMependent filters, but is normally a single 
long red filter 124 which covers all of the sensors of line 122. Another line of sensors 126 is 
behind a green filter line 128, and a third line of sensors 130 is behind a blue filter line 132. 

As the film 104 is moved, the three lines 122, 126, and 130 each provide an individual 
image of the film seen with a different color of light. The data from the circuit package 1 1 2 

30 is sent along cable 1 36 to supporting electronics and computer storage and processing means, 
shown together as computer 138. Inside computer 138 the data for each color image is 



WO 99/40729 PCT/US99/01 674 

grouped together, and the three images are registered as the three color planes 140, 142, and 
144 of a full color image. Each of these color planes 140, 142 and 144 consists of pixels 
describing with a number the intensity of the light at each point in the film. For example, 
pixel 1 50 of the red color plane 1 44 may contain the number "226" to indicate a near white 
5 light intensity at point 1 52 on the film 1 04, as measured at a specific sensor 1 54 in the array 
1 10, shown enlarged in circle 120 as sensor 156 behind the red filter line. 

In FIG. 1 it is noted that there is a spacing between sensor lines 122, 126 and 130, and 
therefore the same point on the film 1 04 is not sensed by all three color lines at the same point 
in time. FIG. 2 illustrates this registration problem in more detail. 

1 0 In FIG. 2 there is a trilinear array (not shown) with red, green, and blue sensor lines 

202, 204, and 206. These lines are projected onto a substrate (not shown) which is moved in 
the direction of the arrow to scan out regions of the image on the substrate. The region seen 
by each line is different from the region seen by the other lines. For example, at the beginning 
of an arbitrary time interval, sensor 210 of the blue line 206 may see point 212 of the 

15 substrate, while at the end of the time interval, it may^see point 214. It is apparent that each 
of the different sensors 210, 220 and 230 sees a different area during the same time interval. 
For example, at the end of the time interval, sensor 220-of the red sensor array 202 sees point 
222, which is different than point 214 seen by the blue sensor 210 at the same end time. 
However, if the time interval is long enough, there will exist a region of overlap 224 over 

20 which all array lines have passed. If the interval between measurements is an integer 
submultiple of the spacing between the arrays, then there exists a time at which sensor 230 
of the green line 204 sees the same point 232 on the substrate as 214, and another time at 
which sensor 220 of the red line 202 sees point 234, the same as point 214, which in turn will 
be seen by the blue sensor 210 at a later time. The computer system 138 receiving the 

25 information from the scans made by the trilinear array registers the data representing the three 
color images by shifting the data an amount corresponding to the distance between sensor 
lines, and discarding the part of each color record outside the full color range overlap 224. 

Although this illustration has presented a so-called transmission, or film, scanner, a 
reflection, or print, scanner uses the same principles except that the source light is reflected 

30 from the same side as the imaging lens. , As is explained later, there are uses for the present 
invention in both transmission and reflection scanners. 
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The conventional scanners described above scan in the three visible colors, exclusive 
of the invisible infrared. There are several reasons that it would be useful to add an infrared 
record registered to the conventional colored records. For example, examination of old 
documents under infrared with a reflection scanner is proving useful in examination of 
5 historic works, such as the Dead Sea Scrolls, to disclose alterations. Another potential use 
presented here without admission that it is known in the art, is to distinguish the "K" or black 
channel from the cyan, magenta, and yellow channels in a four color print. Currently a major t 
commercial use of infrared plus visible scans is a technology called infrared surface defect 
correction, as explained in FIG. 35<2unent appUcatio^ 
1 0 , are limited. to transmission scanners, although it may be extended to reflection scanners, and 
therefore (he specific illustration of a transmission scanner given below is not to be considered 
a limitation. 

In FIG. 3, a lamp 302 transiliuminates filmstrip 304 containing an image 306. An 
electronic camera 308 views the image 306 and outputs red, green, and blue digitized records 

15 3 1 0, 3 1 2, and 3 1 4. In addition the electronic camera 308 outputs an infrared record 3 1 6. 
There are several ways a conventional camera can be made responsive to selectively visible 
and infrared light. One way is to provide a_ filter wheel 320 with four filters: red 322, green 
324, blue 326, and infrared 328. If the camera 308 is a monochrome camera whose sensitivity 
extends into infrared, then the three-visible colors and infrared may be captured at four 

20 different times, each time illuminating the film with a different filter in the filter wheel 320. 

The cyan, magenta, and yellow dyes that create the image 306 are all transparent to 
infrared light, and therefore the film 304 appears clear to camera 308 when viewed under 
infrared light. On the other hand, surface defects such as dust, scratches, and fingerprints 
refract the light passing throughjhe film 304 away. from the camera 308, and therefore appear "~ 

25 as darkened points under b5th visible and infrared light. Because refraction under infrared 
light is nearly equal to refraction under visible light, the defects appear nearly as dark in the 
infrared as in the visible spectrum. ,J 

Therefore infrared record 316 is effectively of a clear piece of film including defects, , 
and image 3 1 0 contains the same defects plus the red image. The infrared image 3 1 6 provides 

30 a pixel by pixel "norming" for the effect of defects. For example, defect-free pixel 340 in the 
red record 310 may contain a 50% brightness measurement. The corresponding defect-free 
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pixel 342 in the infrared record 316 contains 100% brightness because no defect has 
attenuated the light. Function block 344 divides the 50% brightness level fiom the red record 
310 by the norming 100% brightness level from the infrared record 316 to give a 50% 
brightness measurement for corrected pixel 346. On the other hand, pixel 350 under scratch 
5 352 in the red record 310 may contain a 40% brightness measurement. The corresponding 
pixel 354 in the infrared record 316 seeing the same scratch may contain 80% brightness 
because the scratch has refracted 20% of die light. When function block 344 divides 40% by 
80%, a corrected brightness value of 50% is determined for pixel 356. Note that corrected 
pixels 346 and 356 within the same background area of the image now both contain the same 

1 0 brightness value of 50%, so the effect of the scratch has disappeared. This division is repeated 
for each pixel to produce the corrected red record 360; and the same division by infrared is 
applied to the green record 3 12, and blue record 3 14, to produce the corrected green and blue 
records 362 and 364, resulting in a full color corrected image. 

There are several ways of generating an infrared scan-iu conjunction with a visible 

15 scan. One method makes four passes across tteroriginal image using a light that changes 
color between passes, as 

was shown in FIG. 3. Unfortunately, this can take four times sis long as a single pass scanner. 
Alternately, one can make a single pass while flashing four lights in rapid succession, but 
again the hardware may need-to move at one fourth the speed. None of these prior art 
20 methods combines the speed obtained with a single pass multilinear array with the image 
clarity possible in the priQF?art attained by making multiple scans. It is apparent that the 
introduction of such a system would provide an improvement to the state of the art in infrared 
surface defect correction, as well as to the other uses of combined infrared and visible scans 
mentioned above. - 




25 



SUMMARY OF THE INVENTION 



The present invention adds a line to a conventional multilinear sensor array. The 
added line is specific to the infrared scan. In the most direct embodiment, the added line 
30 makes what was a trilinear array containing three lines, one for each of three primary colors, 
into a quadrilinear array. In a second embodiment, the red and blue sensor lines are combined 

-4- 
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into one line that alternates between red and blue sensors. This second embodiment uses only 
two lines for sensing full color, allowing the third line of existing trilinear layouts to be 
devoted to infrared. 



5 BRIEF DESCRIPTION OF THE DRAWINGS 



For a more complete understanding of the present invention and for further 
advantages thereof, reference is now made to the following Description of the Preferred 
Embodiments taken in conjunction with the accompanying Drawings in which: 
10 FIG. 1 shows a conventional trilinear film scanner; 

FIG. 2 illustrates registration of a multilinear array; 
FIG. 3 explains the operation of infrared surface defect correction; 
FIG. 4 shows the present invention with a quadrilinear line and infrared filter; 
FIG. 5 graphs thecolor transmission of available filters; 
1 5 FIG. 6 shows the preferred embodiment with a dichroic prism; 

FIG. 7 illustrates the infrared focus shift common to imaging lenses; 

FIG. 8 charts the filter arrangement of a trilinear infrared sensor, 

FIG. 9 charts the filter arrangement of an alternate trilinear infrared sensor; and 

FIG. ,10 presents missing color recovery used with the sensor shown in FIG. 7. 



20 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 



FIG. 4 shows a prior art trilinear array with the addition of the novel fourth sensor line 
for infrared scanning. In this figure, sensor line 402 contains individual photosites 404,-each 

25 behind a red filter, in perspective, it is seen that the line 402 consists of a row of silicon 
photosensor sites 406 behind red filter material 408 to render the row of photosites 406 
responsive primarily to red light. Similarly, the photosites in sensor lines 410 and 412 are 
made primarily responsive to green and blue light, respectively. Together these three lines 
402, 410 and 412, in conjunction with their overlaid filters, form a prior art trilinear sensor 

30 array. These three silicon lines with their overlaid filters are typically contained in a package 
414 under cover glass 416. 

-5- 
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The present invention teaches the addition of another line 420 to the device which is 
specific to infrared light. Silicon sensor material is inherently sensitive to the lower end of 
the infrared spectrum, so the layout and construction of the extra sensor line 420, shown in 
perspective as line 424 having photosites 422, may be a copy of one of the other three lines, 
such as line 428 or 430. The manufacture of a silicon sensor line, and the duplication of 
multiple copies of a silicon circuit, called "macros" onto a silicon die, are well known in the 
art. 

Line 420 is made primarily responsive to infrared light by removing visible light 
reaching the photosensor sites 422 with a line of infrared-passing, visible-absorbing filter 
material 424. Infrared filter material 424 would appear black to the human eye... A number 
of such infrared materials are known in the art. As an example, a double layer filter, the first 
layer consisting of the filter material 408 printed to make the red line 402, overlaid with a 
second layer consisting of the filter material printed to make the green line 428, would 
together absorb visible light and transmit infrared. In feet, any two or three of the visible 
colors combined would absorb visible and pass infrared light. Because these filter materials 
are already present in the printing of the other two lines, this method would enable 
ma nufacture of the infrared filter 424 without requiring any additional dye types-in the 
fabrication process. 

rt^__- ^Unfortunately, a problem arises when using the device described thus far. - This 
problem is explained using FIG. 5 wherein the transmission of typical organic colored dyes 
commonly used to form the colored filter lines of FIG. 4 are graphed. Although the-infrared 
line is rendered primarily responsive to only infrared light by the infrared filter, the other 
colors axe specific not only to their labeled visible color, but to infrared light as well, as is 
sera by observing that the labeled color graphs in FIG. 5 transmit infrared light When^scan 
is made in which each of the visible records also contains infrared light, a faded and 
excessively surface-defect-sensitive image results. Therefore, in the prior art, either a light 
source was used that had no infrared content, or an infrared blocking filter was placed 
somewhere in the light path, such as at the light source itself or as a component of the cover 
glass in the sensor circuit package. 

In the present invention, in order to overcome this problem and sense infrared in one 
sensor line, infrared light cannot be blocked before reaching the sensor package. Therefore, 
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the infrared blocking filter must be combined with the visible filters at the sensor. In one 
embodiment of the present invention, the visible color filters of lines 408, 428, and 430 of 
FIG. 4 are manufactured with a process that absorbs or reflects infrared light. Such a process 
may use multilayer interference filters commonly known in the art. These filters require many 
5 layers, and in order to produce three colors on the same substrate, the substrate would need 
to be deposited many times resulting in difficult and expensive manufacturing. 



.^blocl^.i!Ut6^.431..,laid over the three visible lines 408, 428, and 430, but having a 
terminating edge 432 between the last visible color sensor line 430 and the infrared line 424. 
1 0 This blocking material 43 1 , shown also as filter 434 in circuit package 4 1 4, could be placed 
on top of the cover glass 416, manufactured as part of the cover glass, or ideally placed under 
the cover glass and directly over the sensor lines. 

An infrared absorbing filter, such as is available from Schott Optical of Germany, 
typically is relatively much thicker than the organic colored filters, and therefore creates a 
15 shadowing parallax problem at the edge 432 over sensor lines that are very close. This 
shadowing may be minimized by moving the thick filter closer to the sensor lines when 
_~placing it under the cover glass 416, and is also made less objectionable by moving the 
infrared sensor line 424 further from the last visible line 430. In the arrangement of FIG. 4, 

fee spacing S2 between the visible and infrared lines is made greater thanthe spacing S 1 

20 between the visible lines. In particular, for maximum step resolution flexibility, the ratio 
S2/S 1 should be an integer. In the specific illustration of FIG. 4, the ratioof S2/S 1 is two. 



visible from infrared light is shown in FIG. 6. This embodiment has the added advantage of 
shifting the infrared focus plane to correct for common chromatic aberrations caused by 

25 imaging lenses. 

In FIG. 6 the three visible color sensor lines 602, 604, and 606 lie under red, green, 
and blue filter lines 608, 61 0, and 612, respectively, as previously illustrated in FIG. 4. Also 
novel infrared sensor line 614 is added to practice the present invention, but unlike FIG. 4, an 
infrared filter line over sensor line 614 is optional. All these lines are housed within circuit 

30 * package 620 under a transparent cover glass 622. Also included is a dichroic prism 624 which 
may be mounted on the cover glass 622, incorporated as a part of the cover glass (shown 



As an improved embodiment, FIG. 4 teaches the use of a cut piece of infrared 




A preferred embodiment pf Jhe present invetftibm^ 
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separately at 626), or incorporated under the cover glass in contact with the sensor lines as 
illustrated in the enlarged illustration 600 of FIG. 6. 

In the enlarged illustration 600, a first prism 630 has a surface 632 coated such that 
a light ray 634 is split into a transmitted visible component 636 and a reflected infrared 
component 638. Such a surface coating is commonly known in the art as a "hot mirror", 
because the heat, or infrared, component is reflected. Hot mirrors are available from Edmund 
Scientific Corporation of Barrington, New Jersey. Bonded to the first prism 630 is a second 
prism 640 constructed with parallel surfaces such that the reflected infrared component 638 
is further reflected at surface 642 so as to be directed toward infrared sensor line 614. The 
reflection surface 642 is preferably coated so as to enhance reflection while preventing light 
incident from above the second prism 640 from penetrating to the sensor line 614. A coating 
material commonly used in mirrors for high infrared reflectivity is gold. 

The apparatus of FIG. 6 has a significant advantage over the apparatus of FIG. 4, as 
explained with reference to FIG. 7. In FIG. 7, it is noted that the focus plane for infrared light 
is displaced relative to the focus plane for visible light The focus difference is shown greatly 
exaggerated in FIG. 7. In a typical achromatic lens, the focus shift 702 is about 0.25% of the 
visible focal length for infinity which would be about 0.5% of 4he combined visible focal 
distance 704 of the lens in FIG. 7 operating at a unity magnification. Returning to FIG. 6, it 
is noted that the virtual image 650 of the infrared line 614 is displaced by distance 652 below 
the visible sensor lines. Distance 652 is equal to Dl 654 divided by the index of refraction 
to infrared light of prism section 640. The displacement distance D l 6544s defined by the 
characteristics of prism section 640, and is preferably chosen to be the distance between the 
infrared sensor line and the middle visible sensor line. 

Note that the distance Dl 654 is easily controlled at manufacture as a function of the 
thickness of prism section 640 and is not affected by misalignments in laying the prism over 
the sensor lines. Therefore, an otherwise high level of precision is not required in the 
cleanroom where the circuits are packaged. The displacement distance 652 also introduces 
a slight magnification of the infrared image which can be corrected through a resize algorithm, 
such as is commonly known in the art. 

Although it is conceptually simple to duplicate a fourth silicon sensor line, in practice 
it is very expensive to make any change to an existing silicon fabrication process. In addition, 
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more silicon is required for the extra line along with more electronics to support the extra 
data. Accordingly it would be an advantage if an existing trilinear line could be adapted to 
the present invention. Such an adaptation is shown in FIG. 8 which illustrates the application 
of the invention with other than a quadrilinear array. 
5 In FIG. 8, a conventional trilinear silicon sensor is adapted to practice the current 

invention by altering only the filters deposited over the silicon sensors, and not the silicon 
layout itself. To practice the invention, one of the sensor lines 802 is rendered specific to 
infrared scanning by one of the methods discussed above to substantially block noninfrared 
light. One such method, presented above, uses a prism with an infrared reflecting dichroic 
10 coating. 

With one of the three sensor lines dedicated to infrared, only two sensor lines remain 
to receive three visible colors. One line 804 receives a primary color, chosen as green in the 
preferred embodiment The last array 806 must therefore sense the remaining two colors. 
This can be done by alternating the remaining two colors intersiitially at pixel boundaries, 

15 such as by making sensors receptive to red 810 in even rows such as row 16 and to blue 812 
in odd rows such as row 1 5, as illustrated in FIG. 8. 

The primary color may be green as presented above; Jiowever, in an embodiment more 
conservative of photons for use in low light, the primary color used for line 804 is chosen to 
be white, namely the visible light remaining after removal ofinfraredlight with an infrared 

20 blocking filter, but with no auxiliary color filter. The two alternating colors in line 806 are 
then chosen as either cyan and orange or cyan and light red. Such a combination would 
approximately double the number of photons impinging on the silicon sensors after passing 
through the colored filters, and therefore the luminance noise would be less due to lowered 
shot noise. This lowering of luminance noise comes, however^ at. the expense of weaker color 

25 distinction, requiring color amplification and thereby causing increased color noise. In low 
light this has been found to be a practical trade-off. 

The embodiment just described uses row 15 as an example of a row in which each 
point on a substrate, after scanning, has been sensed with infrared, green, and blue light, and 
row 16 as an example of a row in which each point on the substrate, after scanning, has been 

30 sensed with infrared, red, and green light. It does not matter significantly in what time order 
the colors are sensed. The color filter topology of FIG. 9 is seen to produce the same color 
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combinations, and in particular rows 15 and 16 of FIG. 9 arc seen to sense the same colors as 
lines 15 and 16 of FIG. 8, albeit at different times. In fact, the infrared sensors also could 
obviously be interspersed on the other lines in any of the embodiments illustrated in this 
application without departing from the scope of the invention. The embodiment shown in 
FIG. 9 is still considered to have a green selective line; the line has just been interspersed in 
other lines. 

In the reproduction of an image made with the color topology taught in FIG. 8, it is 
necessary to recreate the missing color in each row. Turning to FIG; i 0, the sensed colors are 
named for each pixel of each row, including rows 15 and 16 used in the above examples. The 
missing colors for each pixel of each row are named in parentheses. It is those colors that 
need to be estimated using available known color information. The specific color 
measurements are named using a nomenclature relative to the center pixel: "c" for center, "t" 
for top, 4 V for top right, ' V for right, "bf for bottom right, "b" for bottom, M bl" for bottom 
left, "1" for left, and "tl M for top left. In this example Rc, the unmeasured red value for the 
center pixel, will be estimated. Although this example will estimate the value for one red 
pixel, the same algorithm could apply to any red pixel within any even row, or the blue value 
on odd rows by interchanging red and blue wording. 

The unmeasured value of Rc will be calculated by combining estimates based on color 
information from the surrounding pixels. These estimates^ named as the six estimates Et, 
Etr, Ebr, Eb, Ebl, and Etl. In a preferred embodiment, the diagonal estimates contribute to the 
determination of the unmeasured value just as do the vertical estimates, but at a reduced 
strength, namely Rc=(Et+Eb)/4+(Etl+Etr4-Ebl+Ebr)/8. In another embodiment, more 
efficient of computer time, the diagonal estimates may be completely ignored, namely 

Rc=(Et+Eb)/2. - — 

Next, calculation of the estimates using Et and Eb by name will be disclosed. Any of 
the other estimates Etl, Etr, Ebl, and Ebr may be similarly calculated with the change in 
nomenclature. Most basically, each estimate can be simply the red value of the adjacent pixel, 
namely Et=Rt a nd . Eb= Rb. It is possible to improve the estimate by using the green value that 
is known for all pixels. In particular, it can be assumed, because the real world tends to be 
rather monochromic, that the red value changes with position about as fast as the green value 
changes. Therefore, a particular estimate, such as Et, will use not only the red value of the 

-10- 
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adjacent pixel, but will adjust this value by the amount green changes from the adjacent pixel 

to the center pixel for which red is being estimated. 

For example, Et=Rt+(Gc-Gt) and Eb=Rb+(Gc-Gb) to use the linear change in color. 

Alternately Et=Rt*Gc/Gt and Eb=Rb*Gc/Gb to use the percent change in color. When the 
5 color measurements are directly proportional to lumens, the linear change is found to work 

better when Rt>Gt or Rb>Gb, and the percent change works better when Rt<Gt or Rb<Gb. 

The equations produce the same result when Rt=Gt or Rb=Gb. When the color 

measurements are expressed in the common gamma correct space wherein values are 

proportional to the square root of lumens, the linear change is found to be acceptable in all 
1 0 cases, but with the resultant values clamped so as not to go negative. 

Whereas the present invention has been described with respect to specific 

embodiments thereof it will be understood that various changes and modifications will be 

suggested to one skilled in the art and it is intended to encompass such changes and 

modifications as fall within the scope of the appended claims. 
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CLAIMS 

1. A system for scanning a substrate in visible and infrared light, the substrate 
including a plurality of parallel sensor lines, the system including: 
5 means for substantially blocking noninfrared light to a first sensor line of the 

plurality of sensor lines; and 

means for substantially blocking infrared light to a second sensor line of the 
plurality of sensor lines. 

10 2. The system of claim 1 and further including means for substantially blocking 

infrared light to a third sensor line of the plurality of sensor lines, wherein the second sensor 
line is made primarily responsive to visible light of a first color, and the third sensor line is 
primarily responsive to visible light of a second color. 

15 3 . The system of claim 2 and further including: 

a first filter for passing light of the visible light of the first color, free of 
infrared light to the second sensor line, and a sepond filter for passing Light of the visible light 
of the second color, free of infrared light to the third sensor line. 

20 4. The system of claim 2 and further including: 

an infrared blocking filter for blocking infrared light to the second and third 
sensor lines, and a first filter for passing light of the visible light of the first color plus infrared 
light to the second sensor line, and a second filter for passing light of the visible light of the 
second color to the third sensor line. 



25 



5. The system of claim 2 and further including: 

means for substantially blocking infrared light to a fourth sensor line of the 
plurality of sensor lines, wherein the fourth sensor line is primarily responsive to a visible 
light of a third color. 



30 
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6. The system of claim 4 wherein the infrared blocking filter absorbs infrared 

light 

7. The system of claim 4 wherein the infrared blocking filter reflects infrared 

5 light. 

8. The system of claim 4 wherein the infrared blocking filter reflects infrared 
light toward the first sensor line. 

10 9 - The system of claim 1 wherein said infrared light blocking and noninfiared 

light blocking means comprise a prism. 

10. The system of claim 9 wherein the prism includes a first surface having an 
interference filter to transmit noninfiared light and reflect infrared light 

15 

1 1 . The system of claim 1 0 wherein the prism further includes a second surface 
substantially parallel to the first surface which redirects the reflected infrared light to the first 
sensor line. 

20 12 « The system of claim 2 wherein the third sensor line further comprises a 

plurality of individual sensors wherein a first individual sensor of the third sensor line is 
primarily responsive to a high color within the visible light of the second color, and a second 
individual sensor of the third sensor line is primarily responsive to a low color with the visible 
light ofthe second color. ----- 

25 

13. The system of claim 12 wherein the color ofthe visible light ofthe second 
color is magenta, the high color is blue, and the low color is red. 

14. The system of claim 1 3 wherein the color ofthe visible light ofthe first color 
30 is green. 
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15. The system of claim 12 wherein the color of the visible light of the first color 
is white. 

1 6 . The system of claim 1 5 wherein the high color is cyan. 

5 

1 7. The system of claim 12 wherein the low color corresponding to the position 
of the first individual sensor is estimated as a function of the low color measured by the 
second individual sensor, and the difference in the first color measured by respective 
individual sensors of the second sensor lines at positions corresponding to the first individual 

1 0 sensor and the second individual sensor. 



1 8. A sensor responsive to visible light and infrared light, comprising: 
a substrate; 

a first linear sensor disposed on said substrate and being primarily responsive 
15 to visible light of a first color; 

a second linear sensor disposed on said substrate and being primarily 
responsive to visible light of a second color, 

a third linear sensor disposed on said substrate and being primarily responsive 
to visible light of a third color; 

20 a fou rth linear sensor disposed on said substrate and being primarily 

responsive to infrared light; 

means for substantially blocking infrared light from said first, second, and 
third linear sensors; and 

-jILeans for substantially blocking visible light from said fourth linear sensor. 

25 

19. The sensor of Claim 18 wherein said linear sensors are spaced apart by a 
distance, such that the distance between said first and second sensors and the distance between 
said second and third sensors is less than the distance between said third and fourth sensors. 
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20. The sensor of Claim 18 wherein said blocking means includes a prism. 
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